How Do Gain and Discount Functions Affect the Correlation between DCG and User Satisfaction?

نویسندگان

  • Julián Urbano
  • Mónica Marrero
چکیده

We present an empirical analysis of the effect that the gain and discount functions have in the correlation between DCG and user satisfaction. Through a large user study we estimate the relationship between satisfaction and the effectiveness computed with a test collection. In particular, we estimate the probabilities that users find a system satisfactory given a DCG score, and that they agree with a difference in DCG as to which of two systems is more satisfactory. We study this relationship for 36 combinations of gain and discount, and find that a linear gain and a constant discount are best correlated with user satisfaction.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Learning the Gain Values and Discount Factors of DCG

Evaluation metrics are an essential part of a ranking system, and in the past many evaluation metrics have been proposed in information retrieval and Web search. Discounted Cumulated Gains (DCG) has emerged as one of the evaluation metrics widely adopted for evaluating the performance of ranking functions used in Web search. However, the two sets of parameters, gain values and discount factors,...

متن کامل

Relationship between Students’ Readiness for e-Learning, Learner Satisfaction and Student Performance: The case of a post-graduate education program

The aim of this study was to explore students’ readiness for e-learning during Covid-19, determining learner satisfaction with online learning experiences and their relations with students’ success. A descriptive-analytical research design and Spearman correlation coefficient were used in this study. Population under study, which was considered as the sample, included students of a course in a ...

متن کامل

A New Hybrid Method for Web Pages Ranking in Search Engines

There are many algorithms for optimizing the search engine results, ranking takes place according to one or more parameters such as; Backward Links, Forward Links, Content, click through rate and etc. The quality and performance of these algorithms depend on the listed parameters. The ranking is one of the most important components of the search engine that represents the degree of the vitality...

متن کامل

The effect of quality components of hospital environment on user satisfaction, with a naturalistic approach in Tehran

Introduction: The hospital is of particular importance as a place where the process of caring for and treating the patient's human body (where part of his or her body and mind is damaged) takes place. The hospital environment creates tension and stress, so any effort to reduce this tension and stress will positively result in creating a pleasant feeling and increasing the quality of the environ...

متن کامل

The Impact of Accounting Information System on User Satisfaction: Empirical Studies on Local Government Bank

This study aims at investigating the factors that affect a user’s satisfaction of accounting information systems based on the quality and the perceived usefulness of such systems, and the quality of data involved. The paper analyses the given factors on data collected from Bank Sumut,  Indonesia. In addition, this research also aims to find out whether the influence of perceived ease of use can...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2015